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(57) Abstract: A placement plan is developed for the placement of radioactive seeds in a prostrate for brachytherapy. The placement 
plan is made available to an intraoperative tracking interface which also shows a live ultrasound image of the needle or catheter 
placement in the prostate. The difference in the x-y plane between the planned and actual locations of the needle or catheter is 
calculated, and ftom that diflPraence, the error in position of each seed is calculated. The seeds are moved, or the operator changes the 
number of seeds, and die dose is recalculated. A small column of ultrasound images is taken, and each seed located in the column 
of images is given a confidence level. If the confidence level exceeds a threshold set by the operator, the dosimetry is recalculated. 
Periodically throughout the seed placement, fluoroscopic x-rays are taken, and the seed coordinates are matched to the x-ray image. 
Seed locations with low confidence levels are adjusted based on the x-ray locations, and the dosimetry is recalculated. 
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roENTDFICATION AND QUANTIFICATrON OF NEEDLE DISPLACEMENT 
DEPARTURES FROM TREATMENT PLAN 
Reference to Related Application 

The present application claims the benefit of U.S. Provisional Application No. 
60/200,493, filed April 28, 2000, whose disclosure is haeby incorporated by reference in its 
entirety into the present disclosure. 
Field of the Invention 

The present invention is directed to an in^rovement to treatment plans using 
brachyflierapy or the like and more specifically to a technique for rapid and accurate 
identification and quantification of needle placement departures &om such a treatment plan. 
Description of Related Art 

la the treatm^t of prostate cancer, a metidod is often employed to implant numerous 
radioactive seeds in a carefiillyprq)lanned pattern in three dimensions within the prostate. That 
procedure serves to deliver a known amount of radiation dosage concentrated around the 
prostate, while at the same time sparing radiation-sensitive tissues, such as the urethra, the 
bladder and the rectum. Customarily, 60 to 120 seeds are placed through 1 5 to 30 needles in the 
inferior (feet) to supaior (head) direction. Those needle positions are selected &om a 13x13 grid 
of 0.5 cm evenly spaced taaiplate holes, vMch are used to achieve precise needle insertioa The 
number of those holes which intersect with the prostate cross section, and therefore are 
potentially usable, is typically about 60. The number of mafliematical combinations is therefore 
greatly in excess of 10", each of which is a potential ti^iatinent plan but is associated with 
diEfeent degrees of cancer control and a different likehhood of treatmrnt complications. 
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In current clinical practice, llie design of a suitable seed configuration which is 
customized to the anatomy of a patient is achieved by a highly trained medical physicist or 
dosimetrist by using trial-and-acror manual iterations. The practitioner usually starts with an 
uaitial needle configuration based on experience or rules of thumb, and then adjusts the 
radioactive strength per seed or the locations of certain needles or bofli, until the calculated dose 
intensity distiibution satisfies a set of clinical considerations. That process requires between 15 
minutes and 2 hours, depending on the experience of the tireatment planner and the geometiic 
complexity of the relationship between the prostate and the surroundmg anatomical shiictures. 

Those known tireatment planning processes are typically aidedby one of several available 
commercial computerized t^atment planmng systems. Such treatment planning systems aiable 
the user to outline the prostate m relation to a template grid, to turn on or off any available needle 
positions and seed positions within each needle, and to examine the resultant dose distribution 
in two or fliree dimeavsions. Exanq)les of such planning systems include those offered by 
Multimedia Medical Systems (MMS) of Charlottesville, Virginia, SSGI Prowess, pf Chico, 
Califomia,NucletronPlato, fiom Columbia, Maryland, Computerized Medical Systems (CMS) 
Focus, of St Louis, Missouri, Radiation Oncology Computer Systems (ROCS), of Carlsbad, 
California, AD AC Laboratory's Pinnacle, ofMUpitas, California and Theraplan, available fi:om 
Theratronics hitemational Ltd. of Kanata, Ontario, Canada, 

In a number of such known commacial treatinent planning systans, for example, those 
available from MMS and SSGI, the mitialneedle configuration that otherwise would have to be 
turned on by the human treatinent planner is automatically set up by the computer system. That 
initial setiip is based on single rules of thumb, such as uniform loading, peripheral loading or 
modified peripheral loading, hi a number of instances, the manufectiner claims tiiat its planning 
system offers "automatic planning", "geometric optimization", or "real-time dosunetey". 
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However, none of those commercial planning systems offer true optimization in that the 
automatically loaded seeds are not designed based on customized dosimetric calculations. 
Rather, they are designed to fill tiie space of the prostate in some predetermined manner. 
Thwefore, such known automatic seed loading techniques are designed to save between 15 and 
30 mouse cUcks by the operator (or about 1 minute of operation). However, the user is still 
required to apply his or her exp&A knowledge to iteratively improve vtpon that initial design in 
order to achieve customized planning for any individual patient Thus, there are two significant 
drawbacks of the above-mentioned current techniques: Fust, the complete treatment planning 
process is under the manual guidance of a radiation planning ejcpert using trial and error 
techniques; and second, the adjustment of the delivered dose is achieved by varying fiie 
radioactive strength per seed until an isodose surface with the desired shape and size is scaled 
up or down to the prescription dose, i.e., those techniques will suffer when fbs activity per seed 
is fixed, as at the time of surgical iiioplantation in the operating suite. 

Because of those two severe drawbacks, the currently available commercial treatmait 
planning systems are not suitable for mtraoperative treatment planning in flie surgical suite, 
where the patient is placed under anesthesia in volatile conditions and where the cost per minute 
is very high. The variability of human performance, e3q)erience and stress, and flie graieral 
inability of humans to manage large amounts of numerical data in 1 to 2 minutes are also factors 
that deter current practitioners Sxnm performing intraoperative treatment planning. 

An optinuzation technique fortreatmentplanning is taught byU.S.PatentNo. 5,391,139 
to Edmundson. More specifically, Edntundson is intaided for use with a hi^ dose rate (HDR) 
source which is moved within a hollow needle implanted in a prostate or other anatomical 
portioa The medical personnel usmg the system of Edmundson select a needle location using 
empirically predetermined placement rules. An image is taken of the prostate with the hollow 
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needles implanted in it, and the dwell time of the source at each dwell position in the needle is 
optimized. However, placement itself is not optimized, but must instead be determined by a 
human operator. 

Another optimization technique is taught by WO 00/25865 to one of the inventors of the 
present mvention. An implant planning engine plans implants for radiotherapy, e.g., prostrate 
brachytherapy. The system optimizes intraoperative treatment plaiming on a real-time basis 
using a synergistic formulation of a gaietic algorithm, multi-objective decision theory and a 
statistical sensitive analysis. 

While the above techniques allow calculation of optimized dwell time, placement or the 
like, they do not provide for detection and correction of errors in needle or seed placement 
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Summary of the laventioii 

It will be apparent from the above that a need exists in the art to detect and correct errors 
in implonentation of a treatment plan. 

It is therefore a primary object of the present invention to peacmit rapid and accurate 
identification and quantification ofneedleplacement departures fix>m atreatmentplan generated 
prior to a brachytherapy implant based on real-time ultrasound. 

It is anoflier object of the invention to allow real-time correction to the brachythaj^jy 
dosimetry and iterative compensation of loss of dose coverage due to misplacement of the 
needles/catheters and seeds. 

It is still another object of the invraition to permit such identification, quantification and 
correction without the need for CT or MR imaging during the interval between needle/catheter 
placranent in the target organ and final deposition of radioactive sources for irradiation of the 
target organ. 

To achieve the above and oflier objecte, the present invention is directed to a technique 
for identifying and quantifying needle displacement departures faan a placement plan for the 
placement of radioactive seeds in aprostrate or other internal organ for biachyflierapy or the like. 
The placement plan is made available to an intraoperative tracking intetfece which also shows 
a live ultrasound image of the needle or catheterplacement in the prostate. The difference in ±e 
x-y plane between the planned and actual locations of the needle or catheter is calculated, and 
fix)m that difference, the error in position of each seed is calculated. The seeds are moved, or the 
operator changes the numbra- of seeds, and the dose is recalculated, A small column of 
ultrasound images is takai, and each seed located in tke column of unages is given a confidence 
level. If the confidence level exceeds a threshold set by the operator, the dosimetry is / 
recalculated. Periodically throughout the seedplacanent, fluoroscopic x-rays are taken, and the 
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seed coordinates are matched to the x-ray image. Seed locations with low confidence levels are 
adjusted based on the x-ray locations, and the dosimetry is recalculated. 

In a preferred embodiment, the technique is carried out through the following steps. 

1. The needle/catheter placement plan is made available to an intraoperative tracking 
interface. That interfece contains an electronic worksheet of needle and seed coordinates, a live 
ultrasound image window into which real-time video image of needle/catheter placement is fe4 
and a series of isodose dosimetry panels reflecting flie current state of dose covaage. Each of the 
needles/catheters can be activated by highlighting the corresponding row in the coordinates 
worksheet, or by highlighting the corresponding grid location gr^hically. 

2. Following insertion of each needle/caflieter, a hyperechoic (i.e., bri^) spot sqjpears 
on the live ultiiasound image. That location is manually identified by the operator. The difference 
in the x-y plane between the planned location and the actual location of tiie needle/catheter is 
calculated to give errors Ax and Ay. The em)rs Ax and Ay are then reflected on the grid location. 
The errors of each seed. Ax' and Ay*, are calculated based on stiraight line interpolation at flie 
planned z location of the seed; the said straight Une is constructed by joining two known points: 
(a) the actual needle location shown on ultrasound at flie known z plane, (b) flie template 
coordinate outside ttie patient body, through which flie needle is inserted under precision 
template guidance (tiiereforeatthatlocation Axand Ay shallbe assumed to equal zero). The dose 
is then recalculated by moving flie seeds along flie activated needle/caflieter m x and y by 
amounts Ax' and Ay*, which may be flie same or different for each and every seed. The dosimetry 
iq)datedby such feedback of seed placement enors is redisplayed on flie series of isodose panels. 

In addition, tiie operator is permitted to change the number of seeds deposited by tiie 
needle/caflieter in questioa In fliat case, flie operator is required to eirter flie seed locations along 
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the needle/calheter, which ovenrides the original treatment plan. Seed placement erroK in such 
a case are tracked identically to the procedure described above. 

3. A small column of ultrasound images in 3D is acquired along the straight line as 
constructed above. That column can be perpendicular to the x-y plane, or in fact may often 
sustain an angle a and an angle p fcom the x and the y planes, respectively. The exact number 
of seeds as deposited is identified using image processing algorithms in that column of 3D 
ultrasoundregion of interest. Each seed identified in that manner is assigned a confidence level, 
which depicts the likelihood/uncatainty of seed localizatioa The si2e of that column is initially 
set small; if the total number of seeds found in fbat manner is not equal to the number of seeds 
dqwsited by the given needle/calheter, the width of the column is adjusted (e.g., the width is 
increased to find additional seeds). 

Whereas the previous stq) quantifies the errors Ax' and Ay* for each seed, the ultrasound 
step quantifies Az' for each seed and at the same time further corrects Ax' and A/. If the 
confidence level of a given, seed's localization exceeds a threshold value (to be set by the 
operator), the dosimetry is re-calcukted yet again using the iqjdated seed location and diq)layed 
in the same isodose panels. The isodose calculated is assigned a confidence level, which is a 
numerical conqwsite of the individual confidence levels of the seeds and the dosimetric impact 
of positional uncertainties at each seed location (e.g., in high dose region, positional uncertainty 
has low intact). 

4. Periodically throu^out the seed placement procedure and the end of seed placement, 
a fluoroscopic x-ray may be may be taken m the anterior-posterior direction and at up to ±45 
degrees on either side of the anterior-posterior directions. The seed coordinates as determined 
above are projected in the same orientations. A best match to the x-ray seed projections is made 
based on multiple point matching using those seed identifications with the highest confidence 
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levels. Subsequent to such matching, the seed locations with low confidence levels are adjusted 
based on the x-ray locations. As a result, the confidence levels of those latter seeds are increased 
by a amount reflective of the best match quality. The dosimetry is recalculated. The confidence 
level of the dosimetry is updated using updated confidence levels of the seeds. 
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Brief Description of the Drawings 

A preferred embodiment of the present invention will be set forth in detail witibi reference 
to the drawings, in which: 

Fig, 1 shows a schematic diagram of a system for carrying out the preferred embodiment 
of the present invention; 

Figs. 2A-2C show a flow chart of a process according to the preferred embodiment; 

Fig. 3 shows a user interface used in the preferred embodimrat; 

Fig. 4 shows the user interface of Fig. 3 after the calculation of a needle ojBfeet and also 
identifies certain process steps of Fig. 2A with certain components of the user interface; 

Fig. 5 shows a flow chart of an image processing technique used to identify seeds in the 
ultrasound images; 

Figs. 6A and 6B show an image with a desired grayscale distribution and a histogram of 
the desired grayscale distribution, respectively; 

Figs. 7A and 7B show an image with a typical grayscale distribution and a histogram of 
the typical grayscale distribution, respectively; 

Figs. 8 A and 8B show the image of Fig. 7A after preprocessing and a histogram of the 
resulting grayscale distribution, respectively; 

Figs. 9A and 9B show a sequence of images taken in a column and an identification of 
those images having hyperechoic spots, respectively; 

Fig. 10 shows a plot of a threshold used to locate the hyperechoic spots; 

Figs. UAand IIB showidealandtypicalplots,respectively,ofbrightnessalonganeedle 

path; 

Figs. 12A-12C show three types of peaks which may occur in image data; and 
Figs. 13A-13D show the locations of seeds in image data. 
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Detailed Description of the Preferred Embodiment 

A preferred embodiment of the present invention will be set forth in detail with reference 
to the drawings, in which like reference numerals refer to like elements throughout 

Fig. 1 shows asystem 100 on which the preferred embodiment can be implemented. The 
system 100 includes a computer 102, which can be the same as the computer used in either of 
the above-cited Edmundson and Yu references or any other suitable device. The computer uses 
adisplay 104 and auser input device or devices such as akeyboard 106 and amouse 108. Other 
input devices can be used; for example, the mouse 108 can be replaced by alight pen for use with 
the display 104. The computer also receives input from an ultrasound device 110 and a 
fluoroscopic x-ray device 1 12. 

The system also includes components for administering the brachytherapy to the patient. 
Those components include needles 114 having radioactive seeds 116 spaced theiealong in 
accordance with atreatmentplan. Aten5)late 118 having a grid of holes 120 is used to position 
the needles 114 for insertion into the patent's prostate. The specifics of the needles 114, the 
seeds 1 16 and the template 1 1 8 are known from the prior art cited above. The needles 1 14 can 
be replaced by hollow needles or catheters in accordance with the treatment plan to be used. 

The use of the system 1 00 will now be e)q)lained with reference to the flow chart of Figs. 
2A-2C. In step 202, a treatment plan is developed. Such a treatment plan can be the one 
developed in the above-cited Yu reference and can be developed either on the computer 102 or 
on a different device. In step 204, the treatment plan is made available to an intraoperative 
tracking interface implemented on the computer 102. If the treatment plan is not developed on 
the coiiq)uter 102, an appropriate conununication medium can be provided to supply flie 
treatment plan to the conqputer 102. 



10 



wo 01^2995 PCTAJSOl/11886 

Hie intraoperative tracking interfece is displayed to the user on Uie display 104. As 
shown in Fig. 3, the intraoperative tracking interface 300 includes the following components. 
An electronic woricsheet 302 shows needle and seed coordinates, based on the grid of holes 120 
in the template 118, and identifies needle locations with dots 304. A Uve ultrasound unage 
window 306 shows a real-time image of a section of the prostate obtained &om the ultrasound 
device 110 andallowsareal-time view ofneedleplacementintheprostate. From the placement 
of the seeds, the dosimetry is calculated, and a series of dosimetry panels 308 are shown, each 
showing the dosimetry in a respective slice of the prostate fiom the base to the apex. The 
dosimetry in thepanels 308 is shownby isodose lines 310. The electronic woiksheet302furlher 
includes a spreadsheet 3 12 m which each row indicates one of the needles. The spreadsheet 312 
includes a column 314 mdicating a needle by a number, a column 3 1 6 identifying the hole 120 
in the template 1 18 into which that needle is inserted by its coordinates (letter and number), a 
column 318 indicating an oflfeet, a column 320 indicating the number of seeds on the needle, a 
column 322 indicating a Ax offset of the needle from its planned position, a column 324 
indicating a Ay ofifeet of the needle fiom its planned position, a column 326 indicating the 
number of currently selected seeds whose ofeets have been calculated and a column 328 
indicating a total number of seeds whose of&ets have been calculated. A needle position 304 
which the operator has selected is shown on the interface 300 as flashing, as is the corresponding 
row 330 in fbe spreadsheet 3 12. 

Following the insertion of each needle or catheter m step 206, the live ultrasound image 
306 of the interface 300 displays a bright (hyperechoic) spot 332 in step 208. In step 210, the 
operatormanuaUyidentifiesthespot332,e.g.,bycUckingonitwiththemouse 108. In step 212, 
the he differaice in fiie x-y plane between the planned location and the actual location of the 
needle or catheter is calculated to give errors Ax and Ay, which are shown both on the grid 302 
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and on the highlighted row 330 of the spreadsheet The positional errors in the x-y plane of each 
seed. Ax' and Ay*, are calculated in step 214 based on straight line interpolation at the planned 
z location of the seed. The straigjit line used in the interpolation is constructed by joining two 
known points: (a) the actual needle location shown on ultrasound at the known z plane and (b) 
the template coordinate outside the patient body through \^iiich tibie needle is inserted under 
precision tmplate guidance. At the template 1 18, Ax and Ay are assumed to equal zoto. The 
dose is then recalculated in step 216 by moving Hie seeds along the activated needle or catheter 
in tiie x and y directions by those amounts Ax' and Ay*, which may be die same or different for 
every seed. The dosimetry updated by such feedback of seed placement errors is redisplayed in 
step 218 on the series of isodose panels 308. Fig. 4 shows the updated interface 300 and also 
identifies some of the above-mentioned method steps in association wifli the corresponding 
elemoits of &e interface 300. 

In addition, the operator is permitted to change the numba- of seeds deposited by the 
needle or catheter in question in step 220. In that case, the operator is required to enter the seed 
locations along the needle or catheter, which overrides the original treatment plan in step 222. 
Seed placanent errors in such a case are tracked identically to the procedure described above. 

In step 224, a small column of 3D ultrasound images is acquired along the straight line 
constructed in step 214. That column can be perpendicular to the x-y plane or may be at a non- 
rigji angle from the x and/dr the y planes. The exact number of seeds as deposited is identified 
in step 226, using image processing algorithms to be described below, in the column of 3D 
ultrasound images. Each seed identified in the ultrasound images is assigned a confidence level 
in step 228, which indicates the likelihood or uncertainty of seed localization. 

The size of tiie column is initially set small. If it is determined in step 230 that flie total 
numbCT of seeds found in step 226 is not equal to the number of seeds deposited by the given 
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needle or caflietca:, the width of the column is adjusted in step 232; for instance, the widtii is 
increased to find additional seeds. 

Thus, Az* is quantified for each seed, and at the same time. Ax' and Ay' are finther 
corrected. If it is determined in step 234 that the confidence level of a given seed's localization 
exceeds a threshold value (set by the operator), the dosimetry is re-calculated yet again in step 
236 using the updated seed location and displayed in the same isodose panels. Hie isodose 
calculated is assigned a confidence level in step 238, which is a numerical composite of fiie 
individual confidence levels of the seeds and tiie dosimetric impact of positional uncertainties 
at each seed location. For example, in a high dose region, positional uncertainty has low impact. 

Periodically throughout the seed placement procedure and the end of seed placement, a 
fluoroscopic x-ray image may be may be taken in step 240 in the anterior-posterior direction and 
at U5> to ±45 degrees on eitha: side of the anterior-posterior direction. The seed coordinates as 
determined above are projected in the same orientations in step 242. A best match to flie x-iay 
seed projections is made in step 244 based on multiple point matching using those seed 
identifications with tiie highest confidence levels. Subsequent to such matching, flie seed 
locations with low confidence levels are adjusted in step 246 based on the x-ray locations. As a 
result the confidence levels of those latter seeds are inraeased by a amount reflective of the best 
match quality. In step 248, the dosimetiy is recalculated, and the confidence level of the 
dosimetry is updated using the updated confidence levels of the seeds. 

The image processing algorithms used in carrying out step 226 will now be explained. 
As shown in the flow chart of Fig. 5, tiiere are three basic steps. In step 502, which is a 
preprocessing step, the image brightiiess and contest are adjusted to make the hyperechoic spots 
more distinct In step 504, the seed pathway is bracked for finther correcting the offeets Ax' and 
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Ay' of the implanted seeds. In step 506, the seeds are identified for correcting Az' for each seed 
along the tracking pathway. 

Step 502 involves executing a grayscale transfoimation to each image in the ultrasound 
series from apex to base and is thus apre-processiag step. The purpose of step 502 is to adjust 
the brightness and contrast of the images so that the hyper-echoic sqpots will be more distinct in 
the transformed images. According to e^qperience aquired from many actual OR cases, an image 
suitable for seed recognition processing has a grayscale histogram similar to that shown in Figs. 
6A and 6B, whereas in most cases, the images as taken have grayscale histograms similar to that 
shown in Figs 7A and 7B. 

As shown in Fig. 6B, it is preferred that the background be very dark while ttie 
hyperechoic spots be very distinct. For that prefered case, 50% of thepixels have grayscale levels 
below 30, representing the backgromid and dark issues; 90% of the pixels have grayscale levels 
below 60, wifli grayscale levels between 30 and 60 most likely representing the brighter issues 
of the gland; and 95% of the pixels have grayscale levels below 80, with levels between 60 and 
80 most likely representing some much brighter issues and some weaker airgaps. The pixels 
with the higjiest grayscale levels (from 80 to 255) are the hyper-echoic spots of seeds aad some 
stronger air gqps. 

Here, the images are assumed to have an eight-bit grayscale depth, namely, with 
grayscale values from zero to 255 inclusive. Of course, other grayscale depths can be used 
instead. 

In the images as taken, the 50%, 90% and 95% grayscale levels are higher than the 
preferred ones set forth above, in the example of Figs. 7A and 7B, they are 60, 110 and 135, 
respectively. 
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To transfonn an image as taken into an image as preferred, tbe following grayscale 
transformation scheme can be used: 



Original image 


Transformed image 


Below median (0~50%) 


1 


50%~90% 


1-50 


90%~95% 


51-75 


95%~100% 


76-255 



When the image of Figs. 7A and 7B is subjected to such a transformation, the result is 
as shown in Figs. 8A and 8B. A comparison ofFigs7A and 7B with Figs. 8A and 8B shows that 
the hyper-echoic spots in transformed image of Figs. 8A and 8B are more distinct flxan they are 
in the original image of Figs. 7A and 7B. Thus, it is easier for the subsequent algorithms to track 
and identify the seeds. More importantly, it is possible for the algorithms to use unified 
parametets to process cases with different brightness and contrast settings. 

Step 504, automatic tracking of the seeds along a same needle, is used to correct Ax' and 
Ay* (di^laccment from the planned location) of the implanted seeds. Step 504 involves tracking 
flie pathway of the seeds, not just the seeds themselves. In oAer words, the air gaps are also 
included, and stqp 504 does not discriminate the seeds from the air gaps. Step 504 uses the 
grayscale information the region of interest (ROI), such as Ihe maximum value of a hyper-echoic 
spot, the mean and the standard deviation of the ROI, the contrast definedby ttie maximum value 
divided by the mean, etc. 

In step 504, a center and tiie size of an ROI are preset That operation can be manually 
done by the operator by clicking flie mouse on the hyper-echoic spots at any z-position or 
automatically done by using flie information &om fbe treatment plan. Thresholding and analysis 
are then used to determine whether there is a hyper-echoic spot in the ROI. It there is, the ROI 



15 



wo 01/82995 PCTAJSOl/11886 

center of the next image in flie series is switched to the current center position. If not, the 
previous center is kept. 

Fig. 9A shows a column of images taken along the pathway corresponding to grid 
coordinates 12 in the grid 302 of Fig. 3. Fig. 9B shows the same column of images, with boxes 
identifying the images in which hyperechoic spots have been identified. As shown in Fig. 9B, 
each hyperechoic spot occupies five consecutive images because of the dimensions of the seed 
relative to the interval at which the images are taken; an illustrative example of the relevant 
dimensions will be given below. 

The threshold measurement based on the grayscale analysis of the ROI can be illustrated 
by Fig. 10. For the sake of clarity of illustration. Fig. 10 shows only fho maYimnm^ mean, and 
contrast measurements because they can be shown in a 2-D plot. Fig. 10 is not drawn to scale, 
and the parameters are examples only, used to make the illustration more intuitive. 

The ROI whose grayscale features fall in the shadow area of Fig. 10 is identified as an 
ROI containing a hyper-echoic spot In the figure, the four borders of the shadow area are 
represented with four lines a, b, c, and d, respectively. The lines a and b indicate that the 
maximum value of the ROI should be between grayscale levels 75 and 255. The hne c indicates 
that the mean value of the ROI should be greater tiian 5. The line d mdicates that the contrast 
(the slope of the line in the 2-D coordinate system constructed by the mean and maximum) 
should be greater than 2. 

In practice, the line d may be replaced by a curve e (ttie dotted curve in Fig. 10), which 
delimits the border more accurately. That is because variations of the mean and the contrast may 
result in dififCTent thresholds. Generally speaking, the greater the mean, the smaller the threshold. 
As a result, curve e is in the form as shown in the figure. The curve e can be implemented as a 
curve equation or as a look-up table for correlating the threshold to the mean. 
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ExtQiding the illustrative example of Fig. 10 to more measurement parameters results in 
a multi-dimensional space and a shadowed sub-space similar to the shadow area in the 2-D space 
in Fig. 10. 

Step 506, detecting the real z-position of each seed placed along the needle track, is in 
fact a task of cutting the seed pathway into several segments by discriminating the spots 
rq)resenting seeds ftom any spots representing air gaps. The grayscale information cannot be 
used to achieve that goal because some stronger air gaps have greater measurement values than 
weak seeds, as will be explained below with reference to Fig. 1 IB. Therefore, a wave form 
analysis method is used instead. 

To sunplify the illustration, it is assumed that the distance between two contiguous 
images is 0.5 mm, so that one seed can occupy at most 10 images in the series, and it usually 
occupies fewer than 10 due to its slant Thus, in a case in which the gland has a length of 4.5 cm, 
the ofiset is 5 mm, and there are 5 seeds with special spaciug, i.e, no spacer, at the apex, an ideal 
waveform of a needle track should have the appearance shown in Fig. 1 1 A, having rectangular 
peaks 1 102, 1104, 1 106, 1 108 and 1 1 10 indicating the seeds. However, a real wavefonn is more 
likely to have ttie appearance shown in Fig. 1 IB, having irregular peaks 1112, 1114, 1116, 1118 
and 1 120 indicating the seeds. 

It can be seen in Fig. IIB that al&ough the measured value (MV) of the second peak 
1 1 14 is less than that of the air gap 1 122 between tixe peaks 1 116 and 1 1 1 8 or that of th^ 
1124 between the peaks 1118 and 1120, the second peak 1114 has a wave form of peak, while 
each of the air gaps 1122 and 11 24 has the wave form of valley. That distinction between peaks 
and valleys can be used to discriminate the seeds &om the air gaps. 
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Since it is already known how many seeds are placed in the needle track, the positions 
of the top several peaks are identified as the centers of seeds. In the case of Fig. 1 IB, if the plan 
has four seeds, their positions are taken as the peaks 1112, 1116, 1118 and 1120, but not 1114. 

That principle is simple, while the difficulty is the representation of the MV. Since any 
single grayscale measurement cannotreflect tihie whole feature of the ROI, it is natural to use their 
linear combination as the final MV, i.e., 

in which represents each feature such as maximum, contrast, and standard deviation, etc, and 
represents the coefficient of each feature. Of course, the combination of those features is not 
constrained to the linear composition, which is the simplest one. Sinq)le least square statistics 
will determine the value and the confidence interval for each coefficient 

Of course, the MV waveform should be smoothed before it can be processed because the 
raw signal may contain many noise peaks, as shown in Fig. 12A. Next, the false peaks are 
removed. For example, if two peaks have a distance less than 6 units along the z-axis, they most 
likely represent the same seed, so one of them will be absoibed by the other, stronger one, as 
shown in Fig. 12B. If a peak hes between two other higher peaks and has no distinct drop off 
before and after it, it is most Ukely noise, as shown in Fig. 12C. 

; After those adjustments to the wavefomi, the peaks are detected to detemiine how many 
peaks there are. If the number is greater than the implanted number N of seeds, only the highest 
N peaks are taken as the seeds, as explained above with reference to Fig. IIB. Ifthenumberis 
less than N, either seed identification is forced usmg second-tier peaks (with reduced 
confidence), or the preset transverse size of the ultrasound column is changed to process a larger 
needle track that includes the exact number of the implanted seeds. 
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Figs. 13A-13D show sample seed identifications along gridlocationI2. IhFigs. 13Aand 
13C, flie seeds are identified by black marks M, while in Figs. 13B and 13D, they are left 
unmdrked. 

Each seed identified in tiiat manner is assigned a confidence level according to die MV 
level and the fell-off characteristics of the peak. The greater the MV level and the fell off of the 
peak, the more Hkely it is a seed. The locations of the seeds and their confidence values are 
convoluted into subsequent dosimetry calculations, which result m a confidence level for each 
of the dosimetry parameters arising from flie dose-volume histogram, includmg, DlOO, D95, 
D90,D80andD50. 

If the confidence on the chosen dosimetiy parameter (currently D90) is acceptably high, 
seed localization is said to be reliable enougji for re-planning and re-optimization of dosimetry, 
in order to compensate for the dosimetric impact of the aggregate seed misplacements. If the 
confidence on the chosen dosimetry parameter is not sufficienfly high, simple Baysian statistics 
are used to determine which seed localizations require increased confidence to achieve acceptable 
confidence in dosimetry. Repeat ultrasound scans are acquired; imaging data for the given needle 
column(s) are fiised using redundant information but with increased signal-to-noise ratio. The 
above-describedprocess is repeated starting bom. active seed pathway tracking and ending with 
dosimetry confidence analysis. 

If repeated application of the above process still cannot achieve acceptable dosimetry 
confidence, x-ray imaging of the seeds will be used to increase the localization confidence of the 
given seeds. Ultrasound-based seed idraitification of high confidence values will be used as 
"anchors" (fiducial marks) toregistertheultrasound andx-ray spaces. The coordinates of thelow 
confidence seedlocalizations will thenbecorrectedusingthex-rayprojection(s). The confidence 
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values are increased by a variable based on the degree of seed overlap on the x-ray image, the 
quality of the overall registration, and the quality of the x-ray itself for seed localization. 

While apreferred embodiment of tiie present inventionhas been set forth above m detail, 
those skilled in the art who have reviewed the present disclosure will readily appreciate that other 
embodiments can be realized within the scope of the present invention. For example, the 
numerical values set forth above should be construed as illustrative rather flian limiting. The 
same is true of the aixangement of the user interface of Fig. 3. Therefore, the present invention 
should be construed as limited only by the appended claims. 
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We claim: . 

1. A method for identifying and quantifying departures in placement of needles or 
catheters fiom intended placements in a treatment plan for treating a bodily organ, the needles 
or catheters carrying seeds for insertion into the bodily organ for use in the treatment plan, the 
method comprising: 

(a) inputting the intCTided placements into an intraoperative tracking interface; 

(b) for at least one needle or catheter, calculating a difference in an x-y plane between the 
intended placement of that needle or catheter and an actual placement of that needle or catheter, 

(c) calculating, from the difference calculated in step (b), a position error for each of the 

seeds; 

(d) adjusting positions of seeds along each needle or catheter by an amount detennined 
in accordance with the position ertor calculated in step (c); 

(e) determining positions of a deposited number of seeds fhrougih imaging; 

(f) assigning a confidence level to each of the positions determined in step (e); and 

(g) for each seed whosepositionisassignedaconfidence level exceedingapredetennm 
threshold, recalculating a dosimetry associated with that seed. 

2. The method of claim 1, further comprising: 

(h) adjusting positions of the seeds having low confidence values assigned in step (f) in 
accordance with x-ray imaging; 

(i) recalculating a dosimetry associated with aU of the seeds; and 

(j) assigning a confidence level to the dosimetry recalculated in step (i). 

3. The method of claim 1, wherem ttie intraoperative tracking interface permits an 
operator to select a needle or catheter for step (b). 
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4. The method of claim 1, wherein the intraoperative tracking interface displays at least 
one isodose plot of the bodily organ. 

5. The method of claim 1, wherein step (e) is performed througih real-time ultrasound 
imaging of the bodily organ. 

6. The method of claim 5, wherein: 

the intraoperative tracking interfacepermits an operator to select a needle or catheter; and 
the real-time ultrasound imaging is performed in a direction of the needle or catheter 
selected by the operator. 

7. The method of claim 6, wherein the real-time ultrasound imaging results in a column 
of ultrasound images along the needle or catheter selected by the operator. 

8. The method of claim 7, wherein the column of ultrasound images undergoes gray-scale 
preprocessing. 

9. The method of claim 8, wherein the gray-scale preprocessing corrects a gray-scale 
histogram of the column of ultrasound images to produce gray-scale corrected ultrasound images. 

10. The method of claim 9, wherein the gray-scale corrected ultrasound images are used 
to find locations of the seeds along the needle or catheto: selected by the operator. 

11. The method of claim 10, wh^in the locations of the seeds found in the gray-scale 
corrected ultrasound images are used for further correction of the positions of the seeds. 

12. The method of claim 10, wherein a number of seeds whose locations are found in the 
gray-scale corrected ultrasound images is compared to a number of seeds which are actually 
along the needle or catheta: selected by the operator. 

13. The method of claim 12, whereiti, when the numbers of seeds are not equal, a column 
width of ttie column of ultrasound images is changed, and the column of ultrasound images is 
taken again. 
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14. The method of claim 1, wherein the hodily organ is aprostate. 

15. A system for identifying and quantifying departures in the placement of needles or 
catheters ftom intended placements in a treatment plan for treating a bodily organ, the needles 
or catheters carrying seeds for insertion into the bodily organ for use in the treatment plan, the 
system comprising: 

an imaging device for imaging the bodily organ; 
an intraoperative tracking interface comprising a display; and 
a computmg device, in electronic communication with the iutraoperative tracking 
interface, for: 

(a) inputting the intended placements into the intraoperative tracking interface; 

(b) for at least one needle or catheter, calculating a difference in an x-y plane between the 
intended placement of that needle or catheter and an actual placement of that needle or catheter, 

(c) calculating, from the difference calculated in step (b), a position error for each of the 

seeds; 

(d) adjusting positions of seeds along each needle or catheter by an amount determined 
in accordance with the position error calculated in step (c); 

(e) determining positions of a deposited number of seeds teough imaging carried out 
through flie imaging device; 

(f) assigning a confidence level to each of the positions determined in step (e); and 

(g) for each seed whose positionis assigned a confidence level exceeding apredetermmed 
threshold, recalculating a dosimetry associated with that seed. 

16. The system of claim 15, wherein the imaging device comprises an x-ray imaging 
device, and wherein the computing device further performs tiie following: 
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(h) adjusting positions of the seeds having low confidence values assigned in step (f) in 
accordance with x-ray imaging carried out through flie x-ray imaging device; 

(i) recalculating a dosimetry associated with all of the seeds; and 

0) assigning a confidence level to the dosimetry recalculated in step (i). 

17. The system of claim 15, wherdn the intraoperative tracking interfece conq)iises an 
input device which permits the operator to select a needle or cathetw for step (b). 

18. The system of claim 15, wherein the intraoperative tracking interface displays at least 
one isodose plot of the bodily organ. 

19. The system of claim 15, wherein: 

the imaging device comprises a real-time ultrasound imaging device; and 
the computing device perfomis step (e) through real-time ultrasound imaging of the 
bodily organ by the real-time ultrasound imaging device. 

20. The system of claim 19, wherein: 

the intiaoperative tracking interfecepeimits an operatortoselectaneedle or catheter; and 
the leal-time ultiasound imaging is pafoimed in a direction of Ihe needle or catheter 
selected by the operator. 

21. Thesystemofclaim20,wherein1hereal-timeultrasoundimaging results inacohmm 
of ultiasound images along the needle or catheter selected by the operator. 

22. The system of claim 21, wherein the computing device perfomis gray-scale 
prqnocessing on the column of xiltrasound images. 

23. The system of claim 22, wherein tbs gray-scale preprocessing corrects a gray-scale 
Mstogramofthecolumnofultrasoundiniagestoproducegr^-scalecQirectedultrasoundimages. 

24. The system of claim 23, wherein the gray-scale corrected ultrasound images are used 
to find locations of the seeds along the needle or catheter selected by the operator.' 
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25. The system of claim 24, wherein the locatioBs of the seeds found in the gray-scale 
corrected ultrasound images are used for further correction of the positions of the seeds. 

26. The system of claim 24, wherein a number of seeds whose locations are found in flie 
gray-scale corrected ultrasound images is compared to a number of seeds which are actually 
along the needle or catheter selected by the operator. 

27. The system of claim 26, wherein, when the numbers of seeds are not equal, a column 
width of the coliunn of ultrasound images is changed, and the column of ultrasound images is 
taken agaia 
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